The Child Behavior Checklist and Youth Self-Report in adolescents with epilepsy : testing measurement invariance of the Attention and Thought Problems subscales

The objective of this study was to test for the measurement invariance of the Attention and Thought Problems subscales of the Child Behavior Checklist (CBCL) and Youth Self-Report (YSR) in a population-based sample of adolescents with and without epilepsy. Data were obtained from the 14-year follow-up of the Mater University Study of Pregnancy in which 33 adolescents with epilepsy and 1068 healthy controls were included for analysis. Confirmatory factor analysis was used to test for measurement invariance between adolescents with and without epilepsy. Structural equation modeling was used to test for group differences in attention and thought problems as measured with the CBCL and YSR. Measurement invariance was demonstrated for the original CBCL Attention Problems and YSR Thought Problems. After the removal of ambiguous items (“confused” and “daydreams”),measurement invariance was established for the YSR Attention Problems. The original and reduced CBCL Thought Problems were noninvariant. Adolescents with epilepsy had significantly more symptoms of behavioral problems on the CBCL Attention Problems, β = 0.51, p = 0.002, compared with healthy controls. In contrast, no significant differences were found for the YSR Attention and Thought Problems, β = −0.11, p = 0.417 and β = −0.20, p = 0.116, respectively. In this population-based sample of adolescents with epilepsy, the CBCL Attention Problems and YSR Thought Problems appear to be valid measures of behavioral problems, whereas the YSR Attention Problems was valid only after the removal of ambiguous items. Replication of these findings in clinical samples of adolescents with epilepsy that overcome the limitations of the current study is warranted.

The Connor-Davidson Resilience Scale (CD-RISC): Dimensionality and age-related measurement invariance with Australian cricketers

Objective This study explored the dimensionality and measurement invariance of the 25-item Connor-Davidson Resilience Scale (CD-RISC; Connor & Davidson, 2003) across samples of adult (n = 321; aged 20–36) and adolescent (n = 199; aged 12–18) Australian cricketers. Design Cross-sectional, self-report survey Methods An online, multi-section questionnaire. Results Confirmatory factor and item level analyses supported the psychometric superiority of a revised 10-item, unidimensional model of resilience over the original 25-item, five-factor measurement model. Positive and moderate correlations with hardiness as well as negative and moderate correlations with burnout components were evidenced thereby providing support for the convergent validity of the unidimensional model. Measurement invariance analyses of the unidimensional model across the two age-group samples supported configural (i.e., same factor structure across groups), metric (i.e., same pattern of factor loadings across the groups), and partial scalar invariance (i.e., mostly the same intercepts across the groups). Conclusion Evidence for a psychometrically sound measure of resilient qualities of the individual provides an important foundation upon which researchers can identify the antecedents to and outcomes of resilience in sport contexts.

Factor structure and measurement invariance of the Difficulties Emotion Regulation Scale (DERS) in Spanish adolescents

Resumen tomado de la publicaci??n

Tests of measurement invariance failed to support the application of the "then-test"

Objective
The use of then-test (retrospective pre-test) scores has frequently been proposed as a solution to potential confounding of change scores because of response shift, as it is assumed that then-test and post-test responses are provided from the same perspective. However, this assumption has not been formally tested using robust quantitative methods. The aim of this study was to compare the psychometric performance of then-test/post-test with traditional pre-test/post-test data and assessing whether the resulting data structures support the application of the then-test for evaluations of chronic disease self-management interventions.

Study Design and Setting
Pre-test, post-test, and then-test data were collected from 314 participants of self-management courses using the Health Education Impact Questionnaire (heiQ). The derived change scores (pre-test/post-test; then-test/post-test) were examined for their psychometric performance using tests of measurement invariance.

Results
Few questionnaire items were noninvariant across pre-test/post-test, with four items identified and requiring removal to enable an unbiased comparison of factor means. In contrast, 12 items were identified and required removal in then-test/post-test data to avoid biased change score estimates.

Conclusion
Traditional pre-test/post-test data appear to be robust with little indication of response shift. In contrast, the weaker psychometric performance of then-test/post-test data suggests psychometric flaws that may be the result of implicit theory of change, social desirability, and recall bias.

Measurement invariance across chronic conditions: a systematic review and an empirical investigation of the Health Education Impact Questionnaire (heiQ™).

To examine whether lack of measurement invariance (MI) influences mean comparisons among different disease groups, this paper provides (1) a systematic review of MI in generic constructs across chronic conditions and (2) an empirical analysis of MI in the Health Education Impact Questionnaire (heiQ™).

Evaluating Measurement Invariance with Censored Ordinal Data: A Monte Carlo Comparison of Alternative Model Estimators and Scales of Measurement

Evaluations of measurement invariance provide essential construct validity evidence. However, the quality of such evidence is partly dependent upon the validity of the resulting statistical conclusions. The presence of Type I or Type II errors can render measurement invariance conclusions meaningless. The purpose of this study was to determine the effects of categorization and censoring on the behavior of the chi-square/likelihood ratio test statistic and two alternative fit indices (CFI and RMSEA) under the context of evaluating measurement invariance. Monte Carlo simulation was used to examine Type I error and power rates for the (a) overall test statistic/fit indices, and (b) change in test statistic/fit indices. Data were generated according to a multiple-group single-factor CFA model across 40 conditions that varied by sample size, strength of item factor loadings, and categorization thresholds. Seven different combinations of model estimators (ML, Yuan-Bentler scaled ML, and WLSMV) and specified measurement scales (continuous, censored, and categorical) were used to analyze each of the simulation conditions. As hypothesized, non-normality increased Type I error rates for the continuous scale of measurement and did not affect error rates for the categorical scale of measurement. Maximum likelihood estimation combined with a categorical scale of measurement resulted in more correct statistical conclusions than the other analysis combinations. For the continuous and censored scales of measurement, the Yuan-Bentler scaled ML resulted in more correct conclusions than normal-theory ML. The censored measurement scale did not offer any advantages over the continuous measurement scale. Comparing across fit statistics and indices, the chi-square-based test statistics were preferred over the alternative fit indices, and ΔRMSEA was preferred over ΔCFI. Results from this study should be used to inform the modeling decisions of applied researchers. However, no single analysis combination can be recommended for all situations. Therefore, it is essential that researchers consider the context and purpose of their analyses.

The Career Satisfaction Scale in Context: A Test for Measurement Invariance Across Four Occupational Groups

This study analyzed the influence of the occupational context on the conceptualization of career satisfaction measured by the career satisfaction scale (CSS). In a large sample of N ¼ 729 highly educated professionals, a cross-occupational (i.e., physicians, economists, engineers, and teachers) measurement invariance analysis showed that the CSS was conceptualized according to occupational group membership, that is, 4 of the 5 items of the scale showed measurement noninvariance. More specifically, the relative importance, the response biases, and the reliabilities associated with different career satisfaction content domains measured by the CSS (i.e., achieved success, overall career goals, goals for advancement, goals for income, and goals for development of new skills) varied by occupational context. However, results of a comparison between manifest and latent mean differences between the occupational groups revealed that the observed measurement noninvariance did not affect the estimation of mean differences.

The Career Satisfaction Scale: Longitudinal measurement invariance and latent growth analysis

The present research analyses the adequacy of the widely used Career Satisfaction Scale (CSS; Greenhaus, Parasuraman, & Wormley, 1990) for measuring change over time. We used data of a sample of 1,273 professionals over a 5-year time period. First, we tested longitudinal measurement invariance of the CSS. Second, we analysed changes in career satisfaction by means of multiple indicator latent growth modelling (MLGM). Results revealed that the CSS can be reliably used in mean change analyses. Altogether, career satisfaction was relatively stable over time; however, we found significant variance in intra-individual growth trajectories and a negative correlation between the initial level of and changes in career satisfaction. Professionals who were initially highly satisfied became less satisfied over time. Theoretical and practical implications with respect to the construct of career satisfaction and its development over time (i.e., alpha, beta, and gamma change) are discussed.

Longitudinal Measurement Invariance Issues Illustrated by Examples of Marital Satisfaction in Later Life and the Structure of Psychopathology Before and After Psychotherapy

Talk at the Symposium "Opportunities and Challenges of Longitudinal Perspectives"

Mistreatment and self-neglect in community dwelling older adults: Studies of construct validity, measurement invariance and latent classes

Mistreatment and self-neglect significantly increase the risk of dying in older adults. It is estimated that 1 to 2 million older adults experience elder mistreatment and self-neglect every year in the United States. Currently, there are no elder mistreatment and self-neglect assessment tools with construct validity and measurement invariance testing and no studies have sought to identify underlying latent classes of elder self-neglect that may have differential mortality rates. Using data from 11,280 adults with Texas APS substantiated elder mistreatment and self-neglect 3 studies were conducted to: (1) test the construct validity and (2) the measurement invariance across gender and ethnicity of the Texas Adult Protective Services (APS) Client Assessment and Risk Evaluation (CARE) tool and (3) identify latent classes associated with elder self-neglect. Study 1 confirmed the construct validity of the CARE tool following adjustments to the initial hypothesized CARE tool. This resulted in the deletion of 14 assessment items and a final assessment with 5 original factors and 43 items. Cross-validation for this model was achieved. Study 2 provided empirical evidence for factor loading and item-threshold invariance of the CARE tool across gender and between African-Americans and Caucasians. The financial status domain of the CARE tool did not function properly for Hispanics and thus, had to be deleted. Subsequent analyses showed factor loading and item-threshold invariance across all 3 ethnic groups with the exception of some residual errors. Study 3 identified 4-latent classes associated with elder self-neglect behaviors which included individuals with evidence of problems in the areas of (1) their environment, (2) physical and medical status, (3) multiple domains and (4) finances. Overall, these studies provide evidence supporting the use of APS CARE tool for providing unbiased and valid investigations of mistreatment and neglect in older adults with different demographic characteristics. Furthermore, the findings support the underlying notion that elder self-neglect may not only occur along a continuum, but that differential types may exist. All of which, have very important potential implications for social and health services distributed to vulnerable mistreated and neglected older adults.^

Are guanxi-type supervisor-subordinate relationships culture-general? An eight-nation test of measurement invariance

Three dimensions of subordinate-supervisor relations (affective attachment, deference to supervisor, and personal-life inclusion) that had been found by Y. Chen, Friedman, Yu, Fang, and Lu to be characteristic of a guanxi relationship between subordinates and their supervisors in China were surveyed in Taiwan, Singapore, and six non-Chinese cultural contexts. The Affective Attachment and Deference subscales demonstrated full metric invariance whereas the Personal-Life Inclusion subscale was found to have partial metric invariance across all eight samples. Structural equation modeling revealed that the affective attachment dimension had a cross-nationally invariant positive relationship to affective organizational commitment and a negative relationship to turnover intention. The deference to the supervisor dimension had invariant positive relationships with both affective and normative organizational commitment. The personal-life inclusion dimension was unrelated to all outcomes. These results indicate the relevance of aspects of guanxi to superior-subordinate relations in non-Chinese cultures. Studies of indigenous concepts can contribute to a broader understanding of organizational behavior. © The Author(s) 2014.

Preliminary Development and Psychometric Evaluation of the ACL Scale: Factor Structure, Measurement Invariance, Reliability, and Validity

Thesis (Master's)--University of Washington, 2016-08

Factor structure and measurement invariance of the Health Education Impact Questionnaire: does the subjectivity of the response perspective threaten the contextual validity of inferences?

Objective:
On-going evidence is required to support the validity of inferences about change and group differences in the
evaluation of health programs, particularly when self-report scales requiring substantial subjectivity in response generation are used as outcome measures. Following this reasoning, the aim of this study was to replicate the factor structure and investigate the measurement invariance of the latest version of the Health Education Impact Questionnaire, a widely used health program evaluation measure.
Methods:
An archived dataset of responses to the most recent version of the English-language Health Education Impact
Questionnaire that uses four rather than six response options (N=3221) was analysed using exploratory structural equation
modelling and confirmatory factor analysis appropriate for ordered categorical data. Metric and scalar invariance were
studied following recent recommendations in the literature to apply fully invariant unconditional models with minimum
constraints necessary for model identification.
Results:
The original eight-factor structure was replicated and all but one of the scales (Self Monitoring and Insight) was
found to consist of unifactorial items with reliability of ⩾0.8 and satisfactory discriminant validity. Configural, metric and scalar
invariance were established across pre-test to post-test and population sub-groups (sex, age, education, ethnic background).
Conclusion:
The results support the high level of interest in the Health Education Impact Questionnaire, particularly for use as a pre-test/post-test measure in experimental studies, other pre–post evaluation designs and system-level monitoring and evaluation.

Measurement invariance of English and French Health Education Impact Questionnaire (heiQ) empowerment scales validated for cancer

PURPOSE: If measurement invariance (MI) is demonstrated for a scale completed by respondents from two different language groups, it means that the scale measures the same construct in the same way in both groups. We assessed MI of the French- and English-language versions of the five Health Education Impact Questionnaire (heiQ) empowerment scales validated for the cancer setting. METHODS: Data came from two cross-sectional studies of Canadian cancer survivors (704 English, 520 French). Single-group confirmatory factor analysis (CFA) was used to test whether the hypothesized factor structure of the French-language heiQ empowerment scales fit the data. Multi-group CFAs were conducted to assess different levels of MI conditions (configural, metric, scalar, strict, as well as MI of factor variances, covariances, and latent means) of the French- and English-language heiQ empowerment scales. RESULTS: The correlated five-factor model showed good fit in both language groups (goodness-of-fit indices: CFI ≥ .97; RMSEA ≤ .07). Goodness-of-fit indices and tests of differences in fit between models supported MI of the five-factor model across the two language groups (∆CFI ≤ -.010 combined with ∆RMSEA ≤ .015). CONCLUSIONS: The French- and English-language heiQ empowerment scales measure the same five dimensions of empowerment in the same way across both language groups. Thus, any observed similarities or differences between French- and English-speaking respondents completing these scales are valid and reflect similarities or differences in empowerment across language groups, not measurement artifact. Consequently, heiQ empowerment data from English- and French-speaking respondents can be directly pooled or contrasted in data analyses.